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NON-PROVISIONAL PATENT APPLICATION 
TITLE: INTERNET ADAPTIVE DISCRETE CHOICE MODELING 

5 

INVENTORS: John B. Elmer and D. T. Taylor 
RELATED APPLICATIONS 

This application claims the benefit of U. S. Provisional Application No. 
60/215,695, filed July 5, 2000. Such benefit is provided under 37 CFR § 1.78 (a)(4) and 
10 35 USC § 120. 

TECHNICAL FIELD 

This invention relates generally to determination of consumer preferences using a 
computer network. More specifically, embodiments of this invention relate to adaptive 
discrete choice modeling via the Internet. 
15 DESCRIPTION 
Introduction 

Embodiments of our invention concern certain methods of simulating a 
respondent's purchasing behavior. The methods include employing, as defined by a user, 
a substantially unlimited number of product attributes and a substantially unlimited 

20 number of product attribute levels, generally combined with a respondent's elimination of 
certain of those attributes and/or levels that do not figure into the respondent's purchasing 
decision or simulated purchasing response. 

Embodiments of this invention further include certain methods of communicating 
between a user and a plurality of respondents, such methods include both wired and 

25 wireless. Also contemplated is use of the Internet or other types of computer networks for 
use in communicating between the user and the plurality of respondents. The use of a 
computer network, including the internet, and adaptive discrete choice modeling has 
combinations of properties rendering these techniques superior to, and unique from, 
previously available experimental design, survey administration, survey sampling and 
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forecasting techniques. The techniques described herein are particularly well suited for 
use in determining probable purchasing behavior. Those skilled in the art will appreciate 
that numerous modifications to these embodiments can be made without departing from 
the scope of the invention. For example, although use of questionnaires with 
5 substantially unlimited product attributes and use of a computer network are exemplified 
herein, the questionnaires and simulated purchasing behavior of the respondents may be 
obtained using combinations of other input and output devices and other types of 
products or services or combinations thereof are contemplated. To the extent our 
description is specific, it is solely for the purpose of illustrating embodiments of our 

1 0 invention and should not be taken as limiting the present invention to these embodiments. 
Discrete Choice Modeling 

Discrete choice modeling in general measures estimated purchasing likelihoods 
for products or services. 
Adaptive Discrete Choice Modeling 

15 Adaptive Discrete Choice Modeling (ADCM) allows the use of substantially 

unlimited product attributes and substantially unlimited product attribute levels when 
designing a discrete choice modeling survey to measure respondents' purchase likelihood 
for products or services. 
User 

20 A user as defined herein is any person, group, corporate entity, non-profit entity, 

manufacturer of a product, owner of a brand, provider of a service or combinations of one 
or more of these categories. A user is further defined as the party who desires the 
information from a respondent or a plurality of respondents, regarding their purchasing 
behavior, to permit the user to more accurately design a product or service, a logo, a 

25 name, or to gauge the salability or marketability or market penetrability of the product or 
service. The information may be preferences, real or simulated, of the respondents. 
Respondent 

A respondent, as defined herein, is an individual or a monolithic group of 
individuals who could form part of a market for the user's product or service. 
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Respondent's Preferences 

A respondent's preferences are that group of data that define the simulated 
purchasing behavior of a respondent. 
Population of Respondents 
5 That group of individuals or monolithic group of individuals used to forecast the 

purchasing behavior or market share based on the defined attributes and levels of 
attributes and respondent's input or response to the discrete choice modeling 
questionnaire. 
Purchase Likelihood 

10 Purchase likelihood is the data obtained in response to a discrete choice modeling 

questionnaire in which simulated purchase decisions are made in response to survey 
questions constructed from user defined attributes and attribute levels. 
Market Share 

Market share is calculated as the ratio of sales of company's product or product 
15 line to the total market sales for that product or product line. This ratio is usually 
expressed as a percentage. Market share can be computed for local, state, national or 
international level. 
Marketplace 

The commercial sphere, where buying and selling takes place and the laws of 

20 supply and demand operates. 
Purchasing Behavior 

Among the benefits of ADCM is that a measure of actual purchasing behavior can 
be tested, rather than measuring of attitudes as done in other univariate survey research 
techniques. ADCM provides the user with the ability to measure and forecast a much 

25 wider set of purchasing behaviors because it can measure a substantially unlimited 
number of product attributes and attribute levels, rather than the limited number of 
product attributes and attribute levels required by non-adaptive or other versions or 
applications of discrete choice modeling. 
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Product Attributes 

Product attributes as used herein describe the many facets, features and benefits of 
a particular product or service. Product attributes include, but are not limited to color, 
price, size, shape, speed, accuracy, quality, texture, weight, strength, duration, efficiency, 
5 complexity, turnaround time, volume, vulnerability, load capability, responsiveness, 
smoothness, flexibility, durability, maintainability, reliability, weight of moving object, 
weight of stationary object, length of moving object, length of stationary object, area of 
moving object, area of stationary object, volume of moving object, volume of stationary 
object, speed, force (intensity), stress or pressure, shape, stability of the object's 

10 composition, strength, duration of action of moving object, duration of action by 
stationary object, temperature, illumination intensity, use of energy by moving object, use 
of energy by stationary object, power, loss of Energy, loss of substance, loss of 
information, loss of time, quantity of substance/the matter, reliability, measurement 
accuracy, manufacturing precision, object-affected harmful factors, object-generated 

15 harmful factors, ease of manufacture, ease of operation, ease of repair, adaptability or 
versatility, device complexity, difficulty of detecting and measuring, extent of 
automation, productivity. 
Product Attribute Levels 

Product attribute levels are the individual components of product attributes. For 

20 example, while color may be a product attribute, red, green, blue, yellow, white, purple, 
brown, etc, are product attribute levels. Each attribute may have one or more levels, or 
two levels, or three, or 4 or 5 or 6 or 7 or 8 or 9 or 10 or more levels. 

The number of attributes and attribute levels for adaptive choice modeling is 
substantially unlimited. By substantially unlimited, we intend 2, 3, 4, 5, 6, 7, 8, 9, 10, 1 1, 

25 12, 13, 14, 15, 16, 17, or more up to 100, 200, 300 and all numbers in between. Although 
no upper limit is intended 
Computer Network 

The present techniques are implemented over a computer network, where each of 
the user and respondent (s) access a network by means of an input device and a display 
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device. The input devices may be any method of communicating data, including but not 
limited to keyboard, central processing unit (CPU), personal digital assistant (PDA), 
cellular phone, or similar input device. A display device may be a video display (cathode 
ray tube or CRT), the display element of a PDA, display element of a cellular phone, or 
5 any display means. 

By computer network we intend a means for communicating via two or more 
digital devices. The computer network may be the Internet. The means of communicating 
may be via hard wire, including fiber optics, or wireless. 
Statistically Valid Mathematical Model 
10 Generally, either Conjoint Analysis or Choice Modeling is known to employ 

statistically valid models. 
Statistical Significance 

An observed relationship that is large enough or strong enough not to be due to 
chance. Significant at the 0.05 level is the lowest threshold of significance to be used. 
15 Significance tests are performed to see if the null hypothesis can be rejected. If 

the null hypothesis is rejected, then the effect found in a sample is said to be statistically 
significant. If the null hypothesis is not rejected, then the effect is not significant. The 
experimenter chooses a significance level before conducting the statistical analysis. The 
significance level chosen determines the probability of a Type I error. A statistically 
20 significant effect is not necessarily practically significant. 
A pplication Service Provider 

An application service provider (ASP) is an entity that offers individuals or 
enterprises access over the Internet, to application programs and related services that 
would otherwise have to be located in their own personal or enterprise computers. 
25 Questionnaire 

In general describes the data set of product attributes and attribute levels. A set of 
questions used to gather information in a survey, or the printed paper, computer screen or 
other display mechanism that contains the questions. Questionnaires are used to conduct 
opinion polls and other types of survey research. Survey research is generally accepted as 
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a useful tool by business, political organizations, the mass media, and government as well 
as in academic research. In business, surveys are used to test consumers' preferences and 
to discover what it is about a product that gives it appeal. Response to commercial survey 
aids in planning marketing and advertising strategies and in making changes in a product 
5 to increase its sales. 
Definition of Terms: 

Attribute A feature or benefit of a product e.g. fuel economy. 

Attribute Level A different value for an attribute, e.g. excellent fuel economy, low fuel 

economy or 10 mpg (miles per gallon) 15 mpg, 20 mpg, 25 mpg. 
1 0 Experiment Design A specific design of an experiment that specifies enough experiment 

trials (data points) that the unique contribution of each attribute to the total response can 

be calculated. See "An Introduction to the Theory of Experimental Design", D. J. Finney, 

University of Chicago Midway Reprints. 

Process 
1 5 Alternative A 

1 . Respondent is presented with all possible attributes. He/she is asked to divide the 
attributes into three categories. 

a. Very important 

b. Useful 

20 c. Unimportant 

2. Limiting the levels of attributes 

a. For Very important attributes, the respondent is shown a list of attribute 
levels. The respondent is asked to select any level of the attribute he 
might reasonably expect to want. 
25 b. For Useful attributes, the respondent is shown a list of attribute levels. 

The respondent is asked to select no more than two levels of the attribute 
he might reasonably expect to want. 
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c. For unimportant attributes, the respondent is shown a list of attribute 
levels. The respondent is asked to select one level of the attribute he 
might reasonably expect to want. 

3. The logic creates an analytical hierarchy (Ref. Dr. Tom Saaty, University of 
5 Pittsburgh) of the very important attributes. See "The Analytical Hierarchy 

Process RSW Publishers", incorporated herein by reference for purposed of US 
patent practice. 

a. Respondent completes the analytical hierarchy task. 

4. Optionally, the logic asks the respondent to create an ordered list of attributes 
1 0 from the useful attributes list. 

5. For each very important attribute, the respondent is shown an analytical hierarchy 
of the attribute levels. 

a. The respondent chooses the relative importance of each attribute level. 

6. The very important attributes, logic calculates the relative values of each attribute 
15 and each attribute level. For useful and unimportant attributes, the logic assumes 

certain values of importance as defined by the user. 

The logic now creates a con-joint experiment (Green, Paul E./Rao, Vithala R. 
(1971) "Conjoint Measurement for Quantifying Judgmental Data", in: Journal of 
Marketing Research. Incorporated herein by reference for purposes of US patent 
20 practice) or a choice model experiment or other appropriate multi-task trade-off 

experiment. 

a. The user will pre designate the complexity allowed for the resulting con- 
joint or choice model If the automated design is too complex, the logic 
will select only the highest value attributes for the design. 
25 7. The respondent is now finished. 

8. The software compares the respondent results to the results from the con-joint or 
the choice model. Differences between the results are attributed to interaction 
between the attributes. 
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a. Techniques such as genetic algorithms, or neural networks, mathematical 
programming, or other iterative drive mathematics techniques may be used 
to identify the most like source and contribution of attribute interaction. 

9. The software compares the results from step 7 with the results predicted based on 
5 step 3. Significant variance between these two will, in certain circumstances, be 

attributed to consistency or inconsistency of the respondent 

10. Results from respondents may be clustered into like groups at any appropriate 
step along the process to aid in developing identifiable groupings of respondents, 
which would represent different segments of the population. 

10 a. This option would most likely be initiated after step 8. 

11. Final report for each respondent includes relative values of each attribute and 
attribute levels, plus analysis of interaction between the attributes plus 
consistency of the respondent. 

a. Reports on the individual level and for different segments of the total 
1 5 population will be available. 

Alternative B: 

1. Respondent is presented with substantially all attributes. He/she may be asked to 
divide the attributes into three categories. 

b. Very important 
20 c. Useful 

d. Unimportant 

2. Limiting the levels of attributes 

a. For very important attributes, the respondent is shown a list of attribute 
levels. The respondent is asked to select any level of the attribute he/she 

25 might reasonably expect to want. For example, a car, it might have two 

doors, three doors, four doors, five doors. The respondent may, for 
instance, say four and five door cars only. 

b. For useful attributes, the respondent is shown a list of attribute levels. The 
respondent is asked to select no more than two levels of the attribute he 
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might reasonably expect to want. An example of a useful attribute may be 
cup holders. The choices could be one for every seat, one for every row of 
seats, or no cup holders. The respondent may likely eliminate the no cup 
holders option and keep the other two options. 
5 c. For unimportant attributes, the respondent is shown a list of attribute 

levels. The respondent is asked to select one level of the attribute he 
might reasonably expect to want. An unimportant attribute could be the 
choice between drum brakes or disk brakes. 

3. At this point the set of all reasonable choices which the respondent might choose 
1 0 has been established. 

4. The number of possible choices in the set is typically still large. The respondent 
can only evaluate a small number of these choices before the respondent becomes 
tired, resistant, or overwhelmed by the choices. Typically the limit is time. 
Experience shows that it should take no more than 12-15 minutes for a completed 

15 survey. Therefore, depending on the size of this set of options, the survey logic 

will take specific paths. The particular path may be determined in advance by the 
user in creating the survey. 

a. One path is to only ask the respondent a small random subset of the 
choices. 

20 b. Another path is to consult a database of answers from prior respondents 

for this survey and ask this respondent questions consisting of random 
choices from a subset of choices which excludes choices previously shown 
to prior respondents, 
c. Another path is to use 'design of experiments' techniques (ref: D J. Finney, 

25 "An Introduction to the Theory of Experimental Design", University of 

Chicago Press - Midway Reprints, incorporated herein by reference for 
purposes of US patent practice) and either predefined experiments or 
extemporaneous user designed experiments, then select an experiment that 
closest fits the respondents answers, and have the respondent do the tasks 
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which would meet the data needs for the specific experiment. In using 
'design of experiments' techniques we assumed that respondents are 
directed to specific designs and that the software has the objective of 
receiving balanced responses across all of the designs. Balanced 
5 responses are defined as all options presented to respondents an equivalent 

number of times, so that one option does not appear to be preferred just 
because it was asked more than the others, 
d. Another path is to just have a fixed number of empirically selected groups 
of choices that the respondent is assigned to answer one of the selected 
1 0 groups. The software would assign the groups sequentially or randomly. 

5. In step 4 there is an assumption that the task is so large that no one respondent can 
give the complete answer. The techniques in step 4 are designed to aggregate the 
information from several respondents to give the complete picture of how 
respondents are likely to respond. This aggregation may be accomplished in at 

15 least two ways: 

a. Add responses while the universe of possibilities stays wide. 

b. As responses are added, as it becomes apparent that certain attributes or 
levels of attributes are relatively unimportant, these relatively unimportant 
attributes may be dropped from the possible universe of choices, thereby 

20 focusing more data on the choices that are relatively more important. 

Relatively unimportant attributes are those that get picked measurably 
fewer times than the other alternatives. 

6. In some situations, respondent answers may be grouped into population segments. 
This grouping may be done in at least two ways. 

25 a. Based on separate demographic or screening questions, respondents may 

be placed in separate groups before the processes described in steps 4, 5, 
&6. 
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b. Alternatively, in cases with sufficient data, clustering of respondents based 
on demographic or classification questions can be done after the data 
collection. 
7. The respondent is now finished. 
5 8. Data analysis on this data set is based on steps 4-6 producing an array of 

responses. For example, if there were 10 questions with 5 possible answers each, 
an array is formed that is 10 by 5 by 2. The 2 would hold two values, the number 
of times the item had been presented to respondents and the number of times this 
attribute had been chosen. There may be many points in the array with no data. 
1 o These points will be filled in with regression or interpolation techniques. 

9. At this point each cell in the array will have a likelihood of selection score. A 
purchase likelihood simulator that presents the results of product alternatives in 
terms of market shares can be used. 
Conclusion 

15 The present invention has been described in considerable detail with reference to 

certain versions thereof; other versions are possible. For example, while adaptive 
discrete choice modeling conducted over a computer network or the Internet are 
exemplified, other uses are also contemplated. Therefore, the spirit and scope of the 
appended claims should not be limited to the description of the versions contained herein. 



